Ordering-based pruning for improving the performance of ensembles of classifiers in the framework of imbalanced datasets

The scenario of classification with imbalanced datasets has gained a notorious significance in the last years. This is due to the fact that a large number of problems where classes are highly skewed may be found, affecting the global performance of the system. A great number of approaches have been developed to address this problem. These techniques have been traditionally proposed under three different perspectives: data treatment, adaptation of algorithms, and cost-sensitive learning. Ensemble-based models for classifiers are an extension over the former solutions. They consider a pool of classifiers, and they can in turn integrate any of these proposals. The quality and performance of this type of methodology over baseline solutions have been shown in several studies of the specialized literature. The goal of this work is to improve the capabilities of tree-based ensemble-based solutions that were specifically designed for imbalanced classification, focusing on the best behaving baggingand boosting-based ensembles in this scenario. In order to do so, this paper proposes several new metrics for ordering-based pruning, which are properly adapted to address the skewed-class distribution. From our experimental study we show two main results: on the one hand, the use of the new metrics allows pruning to become a very successful approach in this scenario; on the other hand, the behavior of Under-Bagging model excels, achieving the highest gain with the usage of pruning, since the random undersampled sets that best complement each other can be selected. Accordingly, this scheme is capable of outperforming previous ensemble models selected from the state-of-the-art. © 2016 Elsevier Inc. All rights reserved. ∗ Corresponding author. Tel.: +34 94 816604 8; fax: +34 94 816 8924. E-mail addresses: [email protected] (M. Galar), [email protected] , [email protected] (A. Fernández), [email protected] (E. Barrenechea), [email protected] (H. Bustince), [email protected] (F. Herrera). http://dx.doi.org/10.1016/j.ins.2016.02.056 0020-0255/© 2016 Elsevier Inc. All rights reserved. M. Galar et al. / Information Sciences 354 (2016) 178–196 179